Using a taxi isn't very practical for short trips, since they must be ordered from Rethemnon or Irakleo. Use the little train if it's practical if you want to avoid walking when the sun is too bright. The little train is not just a tour - it is a practical way of getting from A to B in BalÃ. Wait at one of the signs or hail it anywhere and get in when it stops the conductor will look you up on one of the next stops and sell you a ticket.
There are several companies that offer rental cars and scooters in BalÃ, so you should be able to compare prices. Remember to bring an international driver's license if you come from a non EU/Schengen-agreement country. Wearing a helmet while driving a motorcycle is mandatory, but not too strictly enforced, but remember that your health-insurance may be void if you have an accident while not wearing a helmet.